Skip to content

chore(deps): bump vLLM floor to 0.26 and refresh docker matrix - #1971

Merged
slin1237 merged 1 commit into
mainfrom
chore/bump-vllm-0-26
Jul 27, 2026
Merged

chore(deps): bump vLLM floor to 0.26 and refresh docker matrix#1971
slin1237 merged 1 commit into
mainfrom
chore/bump-vllm-0-26

Conversation

@slin1237

@slin1237 slin1237 commented Jul 27, 2026 •
edited by coderabbitai Bot
Loading

Copy link
Copy Markdown
Member

Description

Problem

The CI installer floors vLLM at 0.25.0 with a manual fastapi<0.137 pin, and the release-docker matrix tops out at v0.22.1 — four minor versions behind upstream 0.26.0.

Solution

  • scripts/ci_install_vllm.sh: floor raised to vllm>=0.26.0; the explicit fastapi<0.137 pin is dropped because 0.26's own metadata caps fastapi[standard]<0.137.0,>=0.133.0 (verified from the wheel's requires_dist). The torchcodec/FFmpeg canary and --torch-backend=auto are unchanged.
  • release-vllm-docker.yml: 3-version matrix → v0.26.0 / v0.25.0 / v0.23.0, defaults and examples → v0.26.0. All three tags verified on Docker Hub; note there is no v0.24.x vllm-openai tag, hence v0.23.0 as the third entry.
  • grpc_servicer's vllm>=0.19.0 floor is untouched.

Test Plan

  • Real validation is this PR's e2e matrix: vllm legs across 1-GPU chat/completions/embeddings and 2-GPU PD with both NIXL and Mooncake KV backends.
  • Locally: bash -n clean; 0.26.0 requires_dist verified for the fastapi cap; all matrix image tags verified.
Checklist
  • cargo +nightly fmt passes
  • cargo clippy --all-targets --all-features -- -D warnings passes
  • (Optional) Documentation updated
  • (Optional) Please join us on Slack #sig-smg to discuss, review, and merge PRs

Summary by CodeRabbit

  • Chores
    • Updated Docker release workflows to use vLLM 0.26.0 as the default base image.
    • Updated release input guidance and image tag examples for vLLM 0.26.0.
    • Updated CI installation requirements to use vLLM 0.26.0 or newer.
    • Simplified the CI installation command by removing the explicit FastAPI version constraint.

@slin1237
chore(deps): bump vLLM floor to 0.26 and refresh docker matrix
11279b9 
0.26 caps fastapi<0.137 itself, so the CI installer's explicit pin is
dropped. Release-docker matrix moves to v0.26.0/v0.25.0/v0.23.0 (there
is no v0.24.x vllm-openai tag).

Signed-off-by: Simo Lin <25425177+slin1237@users.noreply.github.com>
@gemini-code-assist

gemini-code-assist Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@github-actions github-actions Bot added the ci CI/CD configuration changes label Jul 27, 2026
@coderabbitai

coderabbitai Bot commented Jul 27, 2026 •
edited
Loading

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: 6f387142-5e35-44e8-8904-2fdf97e2868a

📥 Commits

Reviewing files that changed from the base of the PR and between 52ef817 and 11279b9.

📒 Files selected for processing (2)
  • .github/workflows/release-vllm-docker.yml
  • scripts/ci_install_vllm.sh
📝 Walkthrough

Walkthrough

Updates the Docker release workflow and CI installation script to use vLLM 0.26.0 defaults, fallback images, examples, and minimum version requirements.

Changes

vLLM version alignment

Layer / File(s) Summary
Release image version updates
.github/workflows/release-vllm-docker.yml		 Default, example, and fallback Docker images are updated to newer vLLM versions, led by v0.26.0.
CI installation requirement
scripts/ci_install_vllm.sh		 The minimum installed vLLM version becomes 0.26.0, while the explicit FastAPI constraint is removed.

|

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

Suggested labels: ci, docker

Suggested reviewers: catherinesue, key4ng, xinyuezhang369

Poem

I hopped through the versions, light and bright,
v0.26.0 now leads the flight.
Docker tags line up in a row,
CI installs the newer glow.
FastAPI’s pin hops away—
A bunny-approved release day!

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately reflects the main changes: raising the vLLM minimum to 0.26.0 and updating the Docker release matrix.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/bump-vllm-0-26

Comment @coderabbitai help to get the list of available commands.

@claude

claude Bot commented Jul 27, 2026

Copy link
Copy Markdown

👋 The PR description doesn't fully follow
PULL_REQUEST_TEMPLATE.md:

  • Missing header: ## Changes

Please update the PR description so reviewers have the context they need.

claude[bot]
claude Bot approved these changes Jul 27, 2026
View reviewed changes

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clean dependency version bump. The fastapi<0.137 pin removal is correct — vLLM 0.26's own requires_dist already enforces it. Matrix versions and defaults are consistent throughout both files. No issues found.

@slin1237
slin1237 merged commit b4a80af into main Jul 27, 2026
48 of 50 checks passed
@slin1237
slin1237 deleted the chore/bump-vllm-0-26 branch July 27, 2026 21:47
@slin1237 slin1237 mentioned this pull request Jul 28, 2026
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@coderabbitai coderabbitai[bot] coderabbitai[bot] approved these changes
@claude claude[bot] claude[bot] approved these changes
@gongwei-130 gongwei-130 Awaiting requested review from gongwei-130 gongwei-130 is a code owner
@CatherineSue CatherineSue Awaiting requested review from CatherineSue CatherineSue is a code owner
@key4ng key4ng Awaiting requested review from key4ng key4ng is a code owner
@XinyueZhang369 XinyueZhang369 Awaiting requested review from XinyueZhang369 XinyueZhang369 is a code owner

Assignees

No one assigned

Labels

ci CI/CD configuration changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@slin1237